Control of a Random Walk with Noisy Delayed Information
نویسندگان
چکیده
We consider the control of a random walk on the nonnegative integers. The controller has two actions. It makes decisions based on noisy information on the current state but on full information on previous states and actions. We establish the optimality of a threshold policy, where the threshold depends on the last action, and the noisy information. We apply the result to flow and service control problems.
منابع مشابه
Delayed Random Walk Models of Neural Information Processing
We present and compare two delayed random walk models of neural information processing. A delayed random walk is a random walk in which the transition probability depends on the position of the walker at a time in the past. The rst model is of human neuro-muscular control for postural sway. The other model is for a stochastic single neuron which has a delayed self{exciting feedback. We study ea...
متن کاملDelay estimation from noisy time series
We propose here a method to estimate a delay from a time series taking advantage of analysis of random walks with delay. This method is applicable to a time series coming out of a system which is or can be approximated as a linear feedback system with delay and noise. We successfully test the method with a time series generated by discrete Langevin equation with delay. Estimation of delay from ...
متن کاملA Random Walk with Exponential Travel Times
Consider the random walk among N places with N(N - 1)/2 transports. We attach an exponential random variable Xij to each transport between places Pi and Pj and take these random variables mutually independent. If transports are possible or impossible independently with probability p and 1-p, respectively, then we give a lower bound for the distribution function of the smallest path at point log...
متن کاملDelayed Random Walks and Control
Issues of resonance that appear in non-standard random walk models are discussed. The first walk is called repulsive delayed random walk, which is described in the context of a stick balancing experiment. It will be shown that a type of ”resonant” effect takes place to keep the stability of the fixed point better with tuned bias and delay. We also briefly discuss the second model called sticky ...
متن کاملA Fuzzy Random Walk Technique to Forecasting Volatility of Iran Stock Exchange Index
Study of volatility has been considered by the academics and decision makers dur-ing two last decades. First since the volatility has been a risk criterion it has been used by many decision makers and activists in capital market. Over the years it has been of more importance because of the effect of volatility on economy and capital markets stability for stocks, bonds, and foreign exchange mark...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1995